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(54) Method and apparatus for the coding and display of overlapping windows with transparency. 

(57) A method and apparatus for the coding and 
efficient display of overlapping windows with 
transparency is disclosed. Each pixel within a 
window which is not to be displayed may be 
coded as a 1 transparent " pixel. The disclosed 
method identifies those pixels which have been 
coded as transparent and displays non-transpa- 
rent pixels contained in windows of lower dis- 
play priority in place of the transparent pixels 
contained in windows of higher display priority. 
A pixel coded as transparent may have as- 
sociated with it an integer representative of the 
number of successive pixels in the window 
which are also transparent. A pixel may be 
coded as transparent by assigning to it a pre- 
selected data value which is distinct from values 
otherwise used to indicate, e.g., the color 
and/or intensity for each displayed pixel. The 
disclosed method and apparatus may include 
one or more windows which contain full motion 
video (i.e., television) images, each of which 
may also contain transparent pixels. A pixel also 
may be coded as a "translucent" pixel, where- 
by a combination of the translucent pixel and a 
non-translucent pixel contained in a window of 
lower display priority is displayed. The dis- 
closed method may be used to efficiently recog- 
nize various conditions in the displayed image, 
including the collision of objects and the point- ^ 
ing of a displayed cursor to identified hot 
spots. " £5 
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Field of the Invention 

The present invention relates generally to video 
display systems and more specifically to display sys- 
tems in which a plurality of independent, overlapping 
windows of display data may be simultaneously dis- 
played. 

Background of the Invention 

Computer terminal and digital television display 
systems commonly employ a technique known as 
"bitmapped" graphics. A"bitmap" is a storage array of 
bits ("1s" and "0s") corresponding to the intensity 
and/or color pattern to be displayed at the various lo- 
cations on a display screen. A display system uses 
these bits to properly modulate the electron beam of 
the cathode ray tube, thereby displaying a desired im- 
age. Most commonly, these bits are stored in memory 
as an array, ordered in a left to right sequence within 
a top to bottom sequence (sometimes referred to as 
a raster scan order). As the display screen is scanned 
by the electron beam one horizontal line at a time 
from top to bottom (and from left to right within each 
horizontal scan line), the bitmap data can be readily 
accessed sequentially. Changes in the displayed im- 
age are accomplished by changing the data in the bit- 
map. The display system then displays changed data 
on subsequent scans of the display device. 

Display systems in which a plurality of indepen- 
dent sets of information are displayed concurrently 
on one display device, each set in its own individual 
"window," are well known. In the case of computer-ba- 
sed video display systems, each set of information 
(i.e., the contents of each window) is often associated 
with an individual program executing in a multi-task- 
ing computer system. Thus, a computer user can si- 
multaneously execute multiple applications and may 
view the activity of, or otherwise interact with, each of 
these programs concurrently. In television systems, 
one or more of the windows may contain video image 
displays. For example, several such television pic- 
tures may be "tiled" on a single television screen, al- 
lowing the viewer to watch two or more programs con- 
currently. 

In both the computer display and television exam- 
ples each window may be independently located with- 
in the overall display area. Information to be displayed 
in each of the windows typically consists of a set of 
information elements (pixels) arranged in a field of ar- 
bitrary, rectangular dimensions. Furthermore, the in- 
formation in each such window may be either period- 
ically or continually updated, whereupon the display 
system re-displays the updated information as neces- 
sary. This re-display is achieved by the repetitive 
scanning of the display device, typically a cathode ray 
tube (CRT). On each scan, the current pixel data of 
each window is displayed at the appropriate location 



in the display area. 

The concept of visually "overlapping" windows is 
also well known. Where windows overlap, one win- 
dow may appear to be in front of another window. As 

5 such, the windows in front partially or wholly obscure 
the visibility of the windows in back. For example, in 
television systems one or more of the video images 
may be imbedded in others (a technique commonly 
known as "picture-in- picture"). To achieve the ap- 

10 pearance of overlapping windows, all windows are or- 
dered in a display priority. Wherever more than one 
window is to occupy the same location in the display 
area, the pixels of a higher priority window are dis- 
played instead of the pixels of lower priority windows. 

15 Moreover, the priority ordering of the windows may be 
modified overtime. Such a modification effects the 
resultant display by altering the appearance of which 
windows are in front of which other windows (i.e., by 
changing which portions of windows are visible and 

20 which portions are obscured). Typically, there is also 
a background "window," which occupies the entire 
display area and is permanently assigned the lowest 
display priority. 

One approach to the display of overlapping win- 

25 dows employs a selection algorithm to determine 
which data to display at each location on the display 
screen in order to properly produce the desired im- 
age. Such an algorithm can be readily implemented 
in hardware, resulting in extremely efficient display 

30 systems. The display hardware may be provided with 
pointers to the individual window bitmaps, as well as 
information regarding the location and display priority 
of each window. The hardware then determines, for 
each location on the display screen, from which bit- 

35 map the pixel to be displayed should be retrieved, and 
which pixel data within that bitmap should be used. 

The use of rectangular windows simplifies the 
handling of bitmapped data and the manipulation of 
the windows, resulting in efficient display systems. In 

40 particular, the position and size information for a rec- 
tangular window is commonly represented by only 
four numbers. These may be a horizontal location 
("X") coordinate and a vertical location ("Y") coordin- 
ate to indicate the position of the window in the dis- 

45 play area, and a width and height to indicate the size 
of the window. Equivalently, the four numbers used to 
identify the position and size information may be a 
horizontal start location ("Xstart"), a horizontal end lo- 
cation ("Xend"), a vertical start location ("Ystart"), and 

so a vertical end location ("Yend"), thus defining the four 
corners of the window. 

Window display systems typically display the 
data from individual window bitmaps by determining, 
for each pixel location in the display area, the window 

55 of highest priority which includes that pixel location. 
This determination is straightforward when the win- 
dows are rectangular. For example, when the four cor- 
ners are used as described above to locate each win- 
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dow, that window includes a given X,Y pixel location 
if and only if X is not less than "Xstart" nor more than 
"Xend," and Y is not less than "Ystart" nor more 
than 'Yend.". Furthermore, once the appropriate 
choice of windows is made, retrieving the correct pixel 5 
data for the given pixel location in the display area is 
equally straightforward. Since the data is stored as a 
conventional rectangular array, a simple mathemati- 
cal calculation is sufficient to locate the appropriate 
pixel data. 10 

It would often be advantageous to include the 
ability to display an image contained in a rectangular 
window withoutdisplaying the surrounding portions of 
that window. In effect, these surrounding portions of 
a foreground window would be made "transparent," 15 
so that the images "behind" these portions of the fore- 
ground window become visible. From the viewer's 
perspective, such a capability would provide the 
functional equivalent of displaying "windows" of arbi- 
trary shape. In multimedia applications, for example, 20 
it is desirable to construct video frames composed of 
a background scene plus a number of independently 
controllable objects. One such illustration would be a 
background consisting of an undersea scene, with 
many independently movable fish overlaid on that 25 
scene. If each fish were displayed as a complete rec- 
tangular window, the area of each of these windows 
which is outside the border of the image of the fish it- 
self would inappropriately obscure part of the back- 
ground (or a view of part of another fish) "behind" it. 30 
By displaying only the fish image, and not the sur- 
rounding portions of the window which contains it, a 
much more realistic scene would be displayed. 

Summary of the Invention 35 

A technique is provided for the coding and display 
of a plurality of windows whereby a pixel in one win- 
dow may have an independently specified display 
control parameter whose setting affects the appear- 40 
ance in the display of a pixel in another window. So, 
for example, the setting of the display control para- 
meter for a first pixel in a first window may render a 
second pixel in a second window visible in place of the 
first pixel. In this manner, the first pixel is not dis- 45 
played regardless of the display priority associated 
with its window. 

In accordance with one illustrative embodiment 
of the present invention, each pixel within a window 
which is not to be displayed may be coded as "trans- 50 
parent." Then, upon display, those pixels which have 
been coded as transparent are recognized, and non- 
transparent pixels contained in lower priority windows 
are displayed instead of the transparent pixels con- 
tained in the higher priority windows. In this manner, 55 
specified portions of the window become transparent 
to the images "behind" them. 

In accordance with another illustrative embodi- 



ment of the present invention, each pixel within a win- 
dow may be assigned a display priority which differs 
from the display priority of other pixels in the window 
or the display priority of the window as a whole. Upon 
display, each pixel is then displayed (or not displayed) 
according to its own priority relative to that of other 
pixels in other windows at the same display location. 
Portions of a window may thus be made transparent 
by assigning the pixels contained in those portions a 
display priority lower than that of the non-transparent 
pixels in all other windows. 

A pixel marked as transparent may have advan- 
tageously associated with it an integer indicating the 
number of successive pixels in the window which are 
also transparent. In this manner, the efficiency of a 
display system embodiment of the present invention 
may be increased by avoiding the need to check each 
of these successive pixels for transparency. 

Images may be encoded for display by denoting 
pixels as transparent by assigning a preselected data 
value (or one of a plurality of preselected data values) 
to the pixel, which value is distinct from values other- 
wise used to indicate, e. g., the color and/or intensity 
for each displayed pixel. In this manner, it will not be 
necessary to associate data with each pixel in addi- 
tion to the data field already reserved to store pixel 
color and/or intensity information, provided there ex- 
ists at least one previously unassigned data value for 
that data field. 

A display system embodiment may include one or 
more windows which contain full motion video im- 
ages. Thus, e.g., overlapping television pictures of ef- 
fectively arbitrary shape may advantageously be in- 
corporated and overlapped with displays of other win- 
dows containing transparent portions. 

In accordance with another illustrative embodi- 
ment of the present invention, the parameter associ- 
ated with a first pixel in a first window may render a 
second pixel in a second window visible, but in such 
a manner that the appearance of the second pixel is 
effected by the first pixel. For example, the first pixel 
may be coded as "translucent," so that the resultant 
display (of the second pixel) appears on the display 
screen as a "combination" of the two pixels. In partic- 
ular, although the second pixel will become (partially) 
visible, the first pixel will remain partially visible as 
well. 

Brief Description of the Drawings 

FIG. 1 shows a block diagram of a prior art display 
system for displaying overlapped windows. 

FIG. 2 shows the detailed structure of a window 
state machine included in the system of FIG. 1. 

FIGS. 3 and 4 show windows comprising images 
which have been coded for transparency according to 
an embodiment of the present invention. 

FIG. 5 shows a background scene overwhich the 
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windows of FIGS. 3 and 4 are to be overlaid. 

FIG. 6 shows a resulting display of the back- 
ground scene of FIG. 5 overlaid with the partially 
transparent windows of FIGS. 3 and 4 according to an 
embodiment of the present invention. 

FIG. 7 shows a block diagram of the system of 
FIG. 1 modified to provide for transparency in accor- 
dance with an embodiment of the present invention. 

FIG. 8 shows the detailed structure of a transpar- 
ency detector circuit included in the system of FIG. 7 
in accordance with an embodiment of the present in- 
vention. 

FIG. 9 shows a block diagram of the system of 
FIG. 1 modified to provide for transparency in accor- 
dance with a second embodiment of the present in- 
vention. 

FIG. 10 shows the detailed structure of a trans- 
parency detector circuit included in the system of FIG. 
9 in accordance with the second embodiment of the 
present invention. 

FIG. 11 shows a portion of the block diagram of 
FIG. 7 modified to incorporate full motion video win- 
dows in accordance with a third embodiment of the 
present invention. 

Detailed Description 

FIG. 1 presents a block diagram of a prior art dis- 
play system for the efficient display of overlapping 
windows. In particular, the illustrated system produc- 
es as output the pixel data for display at a given dis- 
play location on a display screen. Note that the dis- 
play screen itself may not be local. That is, the display 
data resulting from the system illustrated in FIG. 1 
may be sent through a communications channel to a 
remote location at which the display screen is located. 
Moreover, this data may be sent in a compressed for- 
mat for efficiency. 

Input signals Xscreen and Yscreen are provided 
to the system. These signals represent the horizontal 
and vertical coordinates, respectively, of the screen 
location to be displayed. Output signal PixelData is 
produced as output by the system for display. The 
system comprises a plurality of Window State Ma- 
chines 12a, 12b,... 12n (hereafter "12"), Priority En- 
coder 14, Window Information Memory 16, Multiplier 
18, Adder 20 and Frame Buffer Memory 22. 

Window State Machines 12 are responsive to in- 
put signals Xscreen and Yscreen. Each produces a 
respective output signal hit#a, hit#b,... hit#n which 
is supplied to Priority Encoder 14. Each Window State 
Machine 12 also receives information representing 
the size and display location fora particular one of the 
windows to be displayed. Specifically, each Window 
State Machine 12 asserts its output signal if the cur- 
rent pixel display location (Xscreen, Yscreen) is with- 
in the boundaries of the window that has been as- 
signed to it, as determined by the size and display lo- 



cation information provided. In this manner, the sig- 
nals hit#a, hit#b,... hit#n are indicative of the set of 
windows which are located so as to include the cur- 
rent pixel display location. Thus, a window in this set 

5 with the highest display priority is the one from which 
the pixel to be displayed at this location must be re- 
trieved. Illustrative circuitry implementing the desired 
function for Window State Machines 12 is shown in 
detail in FIG. 2 and described below. 

10 The windows to be displayed are assigned to 

Window State Machines 12 in order of decreasing dis- 
play priority. In particular, the first Window State Ma- 
chine 12a determines whether the window of highest 
display priority is "active," i.e., whether the current 

15 display location is within that window; the second 
Window State Machine 12b determines whether the 
window of second highest display priority is active; 
and so on. Since each window to be displayed (except 
the background "window") must be assigned to a 

20 unique Window State Machine, it should be appreci- 
ated that the number of Window State Machines 12 
should be sufficient to provide for the maximum num- 
ber of windows it is desired to display. Sixty four win- 
dows has been found to be sufficient for most appli- 

25 cations, but the actual number can be greater or lower 
according to need. 

Priority Encoder 14 is responsive to signals 
hit#a, hit#b,... hit#n from Window State Machines 
12 and produces an output signal window*. This out- 

30 put signal is supplied to Window Information Memory 
16. In particular, output signal window# of Priority En- 
coder 14 specifies the number of the highest priority 
window which includes the current pixel display loca- 
tion (Xscreen, Yscreen) based on signals hit#a, 

35 hit#b,... hit#n. If none of the windows includes the 
current pixel display location, Priority Encoder 14 out- 
puts n+1 for the value of window*, representing the 
background "window." Thus, the pixel to be displayed 
at the current location is determined by Priority En- 

40 coder 14 to be one contained in the window indicated 
by signal window*. Priority Encoder 14 may be im- 
plemented with conventional components familiar to 
those of ordinary skill in the art. 

Window Information Memory 16 produces output 

45 signals width [i] and offset[i]. These output signals 
are supplied to Multiplier 18 and Adder 20, respective- 
ly. Multiplier 18 produces an output signal responsive 
to Window Information Memory 16 output width[i] 
and to system input signal Yscreen. This signal is 

50 supplied to Adder 20. The output signal of Multiplier 
18 is the numerical product of the values of its two in- 
puts. Adder 20, in turn, produces output signal Fra- 
me Buff erAddress responsive to Window Informa- 
tion Memory 16 output offsetp], the output of Multi- 

55 plier 1 8 and system input signal Xscreen. The output 
signal of Adder 20 is the numerical sum of the values 
of its three inputs. 

For each window to be displayed, Window Infor- 
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mation Memory 16 contains data representative of 
the location of the corresponding window bitmap 
(containing the pixel data of the window) in Frame 
Buffer Memory 22. Window Information Memory 16 
also contains data representative of the size and dis- 
play location of the window. In particular, Window In- 
formation Memory 1 6 stores two quantities for each 
window to be displayed. The first quantity stored is 
the width (horizontal size in pixels) of the window, and 
is supplied by Window Information Memory 16 as out- 
put signal width[i]. The second quantity stored is an 
"offset," supplied by Window Information Memory 16 
as output signal offset[i]. Signal offsetp] has been 
pre-computed and stored in Window Information 
Memory 16 according to the following equation: 
offsetp] = WindowBaseAddr[i] - Xstart[i] - (Ys- 

tart[i] * width[i]), (1) 
where WindowBaseAddr[i] is the starting location of 
the corresponding window bitmap in Frame Buffer 
Memory 22, Xstart and Ystart are the display location 
horizontal and vertical coordinates, respectively, of 
the upper left hand corner of the window and widt h[i] 
is the width of the window in pixels. In this manner the 
signal FrameBufferAd dress, as computed by Multi- 
plier 18 and Adder 20, will contain the location in 
Frame Buffer Memory 22 of the particular pixel within 
the window bitmap of the window selected by Priority 
Encoder 14 that is to be displayed at the current dis- 
play screen location (Xscreen, Yscreen). This can be 
seen by the following analysis: 
FrameBufferAd dress = Xscreen + (Yscreen * 

width[i]) + offset[i] 
= WindowBaseAddrp] + (Xscreen - Xstartp]) + 
(Yscreen - Ystart[i]) * width[i] (2) 

Thus, given a bitmap stored in the conventional 
manner as an array ordered in a left to right sequence 
within a top to bottom sequence, FrameBufferAd- 
dress will point to the relative location (Xscreen - 
Xstart), (Yscreen - Ystart) within the bitmap of the 
window selected for display. This location will contain 
the pixel data to be displayed at the current location, 
Xscreen, Yscreen. 

Window Information Memory 16 may be imple- 
mented with a conventional RAM (Random Access 
Memory) or other similar storage device familiar to 
those of ordinary skill in the art. Multiplier 18 and Ad- 
der 20 may also be implemented by conventional 
components (i.e., multipliers and adders, respective- 
ly)- 

Frame Buffer Memory 22 is responsive to output 
signal FrameBufferAddress of Multiplier 20 and 
produces system output signal PixelData, which pro- 
vides the pixel data to be displayed on the display de- 
vice at the current display location (Xscreen, 
Yscreen). The window bitmaps for each of the win- 
dows to be displayed are individually stored in Frame 
Buffer Memory 22, and data representative of the lo- 
cation and dimensions of each bitmap within the 



memory is stored in Window Information Memory 16 
as described above. Frame Buffer Memory 22 may 
also be implemented by a conventional RAM or other 
similar storage device familiar to those of ordinary 

5 skill in the art. 

It should be appreciated that there are alternative 
approaches to the technique described herein by 
which the signal FrameBufferAddress may be de- 
rived. For example, it is possible to avoid the process 

10 of multiplication and addition by a technique wherein 
a counter is added to each Window State Machine 12. 
In particular, at the start of each frame (each scan of 
the display device, beginning with Xscreen, Yscreen 
= 0, 0), the counter of each Window State Machine is 

15 loaded with the Window Base Address of its corre- 
sponding window (i.e., the starting location in Frame 
Buffer Memory 22 of the bitmap for that window). This 
can be achieved by the incorporation of an additional 
register, which stores the Window Base Address, into 

20 each Window State Machine 12. For each screen lo- 
cation at which the output signal hit#a, hit#b,... hit#n 
of a Window State Machine is asserted, the corre- 
sponding counter is incremented. Thus, the address 
contained in the counter will point to the next pixel in 

25 that window's bitmap in Frame Buffer Memory 22. 

In this manner, the counter of the Window State 
Machine 12 which corresponds to the window select- 
ed by Priority Encoder 14 will contain the address in 
Frame Buffer Memory 22 of the pixel to be displayed. 

30 The address contained in the aforesaid counter may 
be readily selected by a selector device controlled by 
the signal window*, and then may be output as the 
signal FrameBufferAddress. Although this techni- 
que is likely to be more efficient with respect to exe- 

35 cution speed, it requires a multiplicity of extra devices 
(an additional counter and register for each Window 
State Machine), The technique illustrated in FIG. 1 re- 
quires only a single multiplier to perform the equiva- 
lent function. Thus, the choice of which approach is 

40 to be preferred depends on the circumstances. 

FIG. 2 shows the detailed circuit structure of 
each Window Sate Machine 12 of FIG. 1. The circuit 
operates by comparing the current display location 
(circuit inputs Xscreen, Yscreen) with the corner lo- 

45 cations of its assigned window to determine whether 
the current location is within the boundaries of the 
window. It comprises Registers 32, 36, 42 and 46, 
Comparators 34, 38, 44 and 48, Flip-flops 40 and 50, 
and And-gate 30. Registers 32, 36, 42 and 46 are 

so loaded with the horizontal start location (Xstart), the 
horizontal end location (Xend), the vertical start loca- 
tion (Ystart), and the vertical end location (Yend) of 
the assigned window, respectively. 

In operation, when the value of Xscreen reaches 

55 Xstart, Comparator 34 sets Flip-flop 40, and when the 
value of Xscreen reaches Xend, Comparator 38 re- 
sets Flip-flop 40. In this manner, Flip-flop 40 is set 
only during the period when Xscreen is between 
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Xstart and Xend. Similarly, when the value of 
Yscreen reaches Ystart, Comparator 44 sets Flip- 
flop 50, and when the value of Yscreen reaches 
Yend, Comparator 48 resets Flip-flop 50. In this man- 
ner, Flip-flop 50 is set only during the period when 
Yscreen is between Ystart and Yend. Therefore, both 
Flip-flops 40 and 50 are simultaneously set only when 
Xscreen is between Xstart and Xend and when 
Yscreen is between Ystart and Yend. Thus, And-gate 
30 asserts the circuit output signal hit only when 
Xscreen, Yscreen is within the boundaries of the as- 
signed window. 

FIGS. 3 and 4 show windows which have been 
coded for display according to an embodiment of the 
present invention. In FIG. 3, the image of object 52 is 
contained in window 51. Area 54 is that part of the 
area of window 51 that does not constitute part of the 
image of object 52. In accordance with the objectives 
of an embodiment of the present invention, it is de- 
sired that object 52 be coded for display so that when 
overlaid on images contained in one or more other 
windows, object 52 is displayed without the contents 
of area 54 being displayed as well. In accordance with 
one illustrative embodiment of the present invention, 
this may be achieved by coding the pixels in area 54 
as "transparent." In this manner, these pixels will not 
be displayed by the system. The images contained in 
other windows "behind" area 54 of window 51 will be 
displayed instead. 

In accordance with another illustrative embodi- 
ment of the present invention, these selected pixels 
may be assigned a display priority which differs from 
the display priority of the unselected (i.e., non-trans- 
parent) pixels in the window. Moreover, this different 
display priority may be lower than the display priority 
of all non-transparent pixels in all windows. In such a 
manner, the visibility of those areas of other windows 
which appear "behind" area 54 (which would other- 
wise not be displayed) will advantageously not be ob- 
scured from view when window 51 is displayed. 

In FIG. 4, the image of object 56 is contained in 
window 55. In this case, however, both area 58 out- 
side of object 56 and area 60 inside of object 56 are 
not part of the image of the object, and it is therefore 
desired to code both of these areas as transparent. 

FIG. 5 shows window 61 containing background 
scene 53. In accordance with an embodiment of the 
present invention, it is desired to display the image of 
object 52 in front of background scene 53, with the im- 
age of object 56 in front of the image of object 52, in 
turn. By coding areas 54, 58 and 60 as transparent 
in accordance with one embodiment of the present in- 
vention, the resulting display of FIG. 6 is achieved. In 
this display, object 56 is the foreground image, the im- 
age of object 52 is in the middle ground, and scene 
53 is in the background. Moreover, area 54 has be- 
come (i.e. been coded as) transparent so as not to ob- 
scure the visibility of that part of scene 53 outside of 



the boundaries of object 52. Also, areas 58 and 60 
have become transparent so as not to obscure the 
visibility of either that part of object 52 outside of the 
boundaries of object 56, or that part of scene 53 out- 

5 side of the boundaries of object 56. 

FIG. 7 shows a block diagram of the system of 
FIG. 1 modified to provide for transparency in accor- 
dance with one embodiment of the present invention. 
The modified system recognizes pixels within a win- 

10 dow being displayed which have been coded as 
transparent as, for example, in the illustrations of 
FIGS. 3 and 4. The system accordingly displays pixels 
contained in overlapped windows of lower priority in- 
stead. The illustrated system produces as output the 

15 pixel data for display at a given display location on a 
display screen, as does the prior art system of FIG. 
1. Specifically, input signals Xscreen and Yscreen 
are provided to the system, representing the horizon- 
tal and vertical coordinates of the screen location to 

20 be displayed, and output signal Pixel Data is pro- 
duced for display. In addition to a plurality of Window 
State Machines 12, Priority Encoder 14, Window In- 
formation Memory 16, Multiplier 18, Adder 20 and 
Frame Buffer Memory 22, as contained in the sys- 

25 tern of FIG. 1, the modified system of FIG. 7 also 
comprises Binary-to-linear Decoder 62, Transpar- 
ency Data Memory 64, and Transparency Detectors 
66a, 66b,. ..66n (hereafter 66). 

In the system of FIG. 7, the output signals hit#a, hit#b, 

30 ... hit#n of Window State Machines 12 are supplied 
to Transparency Detectors 66 rather than directly to 
Priority Encoder 14. These intervening circuits deter- 
mine whether the pixel initially selected for display 
has been coded as transparent. If it has been so cod- 

35 ed, the "hit" signal hit#a/hit#b/.../hit#n for the select- 
ed window is masked (i.e. disabled), thereby forcing 
Priority Encoder 14 to select an alternate window. 

In particular, Priority Encoder 14 will select the 
window of next highest display priority to the window 

40 whose hit signal has just been masked for which the 
current pixel display location (Xscreen, Yscreen) is 
also included in the boundaries thereof. Then, of 
course, the circuitry subsequent to Priority Encoder 
14 will advantageously retrieve the appropriate pixel 

45 data from that subsequently chosen window. This 
pixel data represents part of an image in a lower pri- 
ority window which has been revealed by the trans- 
parency in the higher priority window at this location. 
Moreover, if the re-selected pixel is then deter- 

50 mined to be transparent by another one of Transpar- 
ency Detectors 66, the process will iterate. This iter- 
ation will continue until either a non-transparent pixel 
is found for display at the current location or until the 
background "window" (window* = n+1) is selected by 

55 Priority Encoder 14. (Recall that the background win- 
dow occupies the entire display screen and contains 
no transparent pixels.) When either of these terminal 
conditions is reached the current value of Pixel Data 
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may be declared valid and displayed at the current 
screen location (Xscreen, Yscreen), and the screen 
location may then be advanced. In this manner, the 
pixel displayed at each screen location will be the 
non-transparent pixel of highest priority (i.e., in the 
window of highest priority) whose window is posi- 
tioned such that the pixel is located at the current 
screen location. 

Specifically, Transparency Detectors 66 are re- 
sponsive to output signals hit#a, hit#b,... hit#n of- 
Window State Machines 12a, 12b,... 12n, respective- 
ly, output signals select#a, select#b,...select#c of 
Binary-to-linear Decoder 62, respectively, and output 
signal TransparencyData of Transparency Data 
Memory 64. Illustrative circuitry which implements 
one embodiment of the above described function of 
Transparency Detectors 66 is shown in detail in FIG. 
8 and described below. 

Binary-to-linear Decoder 62 is responsive to out- 
put signal window* of Priority Encoder 14 and pro- 
duces output signals select#a, select#b,... and se- 
lects. The decoder asserts the one output signal se- 
lect#a/select#b/.../select#n which corresponds to 
the number specif ied by input signal window*. This 
enables the corresponding Transparency Detector 66 
to check for transparency of the given pixel in the se- 
lected window. Binary-to-linear Decoder 62 may be 
implemented by a conventional decoder or similar 
components familiar to those of ordinary skill in the 
art. 

Transparency Data Memory 64 is responsive to 
output signal Frame BufferAddress of Multiplier 20 
and produces output signal TransparencyData, sup- 
plied to each Transparency Detector 66. In particular, 
this memory stores the transparency data (e.g., 
whether a pixel is transparent) for each pixel of each 
window. The data is advantageously organized in the 
memory in an identical format as are the window bit- 
maps, as arrays ordered in the conventional left to 
right orderwithin a top to bottom sequence. Moreover, 
the transparency data for each window may be stored 
at the same memory location in Transparency Data 
Memory 64 as are the window bitmaps in Frame Buf- 
fer Memory 22. In this manner, both memory devices 
advantageously use the same input signal (Frame- 
Buff erAddress) as a look-up address, obviating any 
need for separate address calculations. Transparen- 
cy Data Memory 64 may be implemented by a con- 
ventional RAM or other similar storage device familiar 
to those of ordinary skill in the art. Moreover, Trans- 
parency Data Memory 64 and Frame Buffer Memory 
22 may be advantageously consolidated into a single 
memory device. 

FIG. 8 shows the circuit structure of each Trans- 
parency Detector 66 according to one embodiment of 
the present invention. In this embodiment each pixel 
has an associated "flag" (a one bit data item), Trans- 
parencyFlag. This flag indicates whether the pixel 



has been coded as transparent Moreover, each trans- 
parent pixel also has an associated integer, Run- 
Length. This integer indicates the number of succes- 
sive pixels in this window from the current pixel for- 

5 ward which are transparent. In this manner, a contin- 
uous sequence of transparent pixels may be advan- 
tageously processed with increased efficiency, since 
Transparency Detectors 66 often need not check 
each pixel for transparency. Rather, the Transparen- 

10 cy Detectors will inhibit their output ('hit') signal for the 
entire length of the "run" of transparent pixels as spe- 
cified by the value of signal RunLength. Note that 
continuous sequences of transparent pixels are, in 
fact, a very common occurrence, since, in general, 

15 entire areas of windows may be advantageously cod- 
ed for transparency. Both of the aforementioned data 
items which may be associated with each pixel are 
stored in Transparency Data Memory 64. 

Specifically the Transparency Detector circuit of 

20 FIG. 8 provides output signal masked-hit which is ac- 
tive when input signal hit-from-WSM is active unless 
it has been determined that the chosen pixel from the 
selected window was coded as transparent. Input sig- 
nal hit-from-WSM is connected to the hit signal 

25 (hit#a/hit#b/.../hit#n) from the Window State Ma- 
chine which corresponds to the given Transparency 
Detector. That is, hit#a is connected to the hit-from- 
WSM input signal of Transparency Detector 66a, 
hit#b is connected to the hit-from-WSM input signal 

30 of Transparency Detector 66b, etc. 

Input signal TransparencyData comprises two 
component data items, Transparency Flag and Run- 
Length. Since TransparencyFlag is a flag signal and 
thus requires only a single bit, it is advantageous to 

35 provide both signals in a single data field (for exam- 
ple, a single byte). This data field may provide one bit 
(for example, the high order bit) for the flag data while 
the remainder of the field contains the data Run- 
Length. If the number of successive transparent pix- 

40 els exceeds the representative capacity of the signal 
RunLength, the transparency data can be coded as 
a plurality of successive runs of shorter lengths. 

In addition, the Transparency Detector circuit of 
FIG. 8 is provided with input signal clock and input 

45 signal select. Input signal clock is connected to the 
primary clock signal of the system which causes the 
values of the current screen display location 
(Xscreen, Yscreen) to be advanced to the next loca- 
tion. This input clock signal is used by the Transpar- 

50 ency Detector circuit to determine when a continuous 
run of successive transparent pixels, as indicated by 
input signal RunLength, has been exhausted. Input 
signal select is connected to the corresponding se- 
lect signal (select#a/select#b/.../select#n) from Bi- 

55 nary-to-linear Decoder 62. That is, select#a is con- 
nected to the select input signal of Transparency De- 
tector 66a, select#b is connected to the select input 
signal of Transparency Detector 66b, etc. This input 
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signal is used to sample the flag Transparency Flag 
and also to store the count Run Length so that it may 
be decremented with each clock of input signal clock 
to determine when a continuous run of successive 
transparent pixels has been exhausted. 5 

Specifically, the Transparency Detector circuit of 
FIG. 8 comprises Latch 72, And-gate 74, Counter 76 
and Zero Detector 78. The data input and the load 
(latch enable) input of Latch 72 are supplied by input 
signals Transparency Flag and select, respectively. 10 
Thus, whenever the window corresponding to a given 
Transparency Detector is selected (by Priority Encod- 
er 14), Latch 72 will be loaded with a flag which indi- 
cates whether the pixel of that window which is to be 
displayed at the current location has been coded as 15 
transparent. If it has been so coded, the (inverted) 
output of Latch 72, which is provided to And-gate 74, 
will inhibit the active hit-from-WSM input signal from 
being passed through to output signal masked-hit. 
That is, masked-hit will be made inactive whenever 20 
a pixel coded as transparent has been initially chosen 
for display. Latch 72 and And-gate 74 may be imple- 
mented with conventional components. 

Counter 76 and Zero Detector 78 provide the 
means for keeping the output signal masked-hit dis- 25 
abled throughout a continuous run of successive 
transparent pixels, as specified by input signal Run- 
Length. In particular, the parallel data inputs of Coun- 
ter 76 are supplied by input signal RunLength, the 
load input is supplied by input signal select, and the 30 
decrement input is supplied by input signal clock. 
Thus, whenever the window corresponding to a given 
Transparency Detector is selected (by Priority Encod- 
er^), Counter 76 will be loaded with a count of suc- 
cessive transparent pixels, if such a count has been 35 
provided on input signal RunLength. 

The count maintained in Counter 76 will be decre- 
mented each time input signal clock is activated, that 
is, each time the current screen display location 
(Xscreen, Yscreen) is advanced. Thus, when Coun- 40 
ter 76 has been decremented to zero, the run length 
of successive transparent pixels specified has been 
exhausted. Zero Detector 78, which receives the par- 
allel data outputs of Counter 76, will at that time ac- 
tivate its output signal. This output signal is provided 45 
to the reset input of Latch 72, thereby resetting the 
latch. Until the count reaches zero, Latch 72 will re- 
main in the state to which it was set by the first trans- 
parent pixel encountered in the run of successive 
transparent pixels. Thus, the output signal masked- 50 
hit will remain disabled by And-gate 74. 

Note that both the transparency flag and the run 
length data are advantageously set for al[ transparent 
pixels in a run of successive transparent pixels, as if 
each pixel were the first transparent pixel in the run. 55 
This results from the fact that a previously obscured 
window (i.e., one of less than highest priority) may be- 
come visible at a point in the higher priority window 



where there is a transparent pixel within a run of 
transparent pixels, as the current screen display loca- 
tion, Xscreen, is advanced. In this case, the newly 
visible window's Transparency Detector may not have 
been loaded with the data representing the run of 
transparent pixels. 

If the pixel to be displayed is not transparent, 
Counter Counter 76 and Zero Detector 78 will not 
have a meaningful effect on the operation of circuit 
since Latch 72 will already be in a reset state. There- 
fore any data loaded into Counter 76 for such pixels 
will be irrelevant. 

Counter 76 may be implemented with conven- 
tional components familiar to one of ordinary skill in 
the art. For example, if input signal RunLength is 
comprised of 7 bits (one bit less than a byte), a 7-bit 
parallel load, parallel output up/down counter may be 
used. Zero Detector 78 may also be implemented with 
conventional components, such as a multiple input 
Nand- gate having one input for each parallel data 
output of Counter 76. 

Note that pixels that are not coded as transparent 
do not make use of the RunLength field of data as 
stored in Transparency Data Memory 64. Moreover, 
pixels that are coded as transparent do not make use 
of their corresponding pixel data as stored in Frame 
Buffer Memory 22. Thus, in another illustrative em- 
bodiment of the present invention, the two memories 
may be advantageously combined. For example, 
Frame Buffer Memory 22 may be used to store both 
the transparency flag and a data field which stores 
either pixel data for non-transparent pixels or a run- 
length for transparent pixels. 

FIG. 9 shows a block diagram of the system of 
FIG. 1 modified to provide for transparency in accor- 
dance with another embodiment of the present inven- 
tion. In this system, pixels are coded as transparent 
by assigning an otherwise unassigned data value for 
the pixel data as stored in Frame Buffer Memory 22. 
It is most common that the pixel data consists of an 
encoded representation of color and/or intensity infor- 
mation which is provided to the display system for dis- 
play on the display screen. In some cases, there may 
be possible encodings of the pixel data which have 
not been assigned to any of the color and/or intensity 
indications which need to be represented. For exam- 
ple, if 8 bits are provided to represent the intensity 
level of a pixel in a blackand white display system, but 
less than 64 possible intensity levels are distinguish- 
ed by the system, one or more of the remaining en- 
codings of the 8 bits may be used to indicate that the 
pixel has been coded as transparent. 

The illustrated system produces as output the 
pixel data for display at a given display location on a 
display screen, as does the prior art system of FIG. 1 
and the embodiment of the present invention illustrat- 
ed in FIG. 7. Input signals Xscreen and Yscreen are 
provided to the system, representing the horizontal 
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and vertical coordinates, respectively, of the screen 
location to be displayed, and output signal Pixel Data 
is produced for display. In addition to a plurality of 
Window State Machines 12, Priority Encoder 14, Win- 
dow Information Memory 16, Multiplier 18, Adder 20 
and Frame Buffer Memory 22, as contained in the 
system of FIG. 1, the modified system of FIG. 9 also 
comprises Binary-to-linear Decoder 62 and Transpar- 
ency Detectors 82a, 82b,... 82n (hereafter 82). 

Note that unlike the system of FIG. 7, there is no 
need for Transparency Data Memory 64 since the 
transparency information is contained directly in the 
pixel data. Therefore, Transparency Detectors 82 are 
responsive to output signals hit#a, hit#b,...hit#n of 
Window State Machines 12a, 12b,... 12n, respective- 
ly, output signals select#a, select#b,...select#c of 
Binary-to-linear Decoder 62, respectively, and (un- 
like Transparency Detectors 66 of FIG. 7) output sig- 
nal Pixel Data of Frame Buffer Memory 22. Like their 
counterparts in the system of FIG. 7, Transparency 
Detectors 82 determine whether the pixel initially se- 
lected for display has been coded as transparent. If it 
has been so coded, the "hit" signal 
hit#a/hit#b/.../hit#n for the selected window is 
masked (i.e. disabled), thereby forcing Priority En- 
coder 14 to select an alternate window. 

FIG. 10 shows illustrative circuitry which imple- 
ments the structure of one embodiment of the above 
described function of Transparency Detectors 82. 
Like the circuit of FIG. 8, the Transparency Detector 
of FIG. 10 provides output signal masked-hit which 
is active when input signal hit-from-WSM is active 
unless it has been determined that the chosen pixel 
from the selected window has been coded as trans- 
parent. Input signal hit-from-WSM is again connect- 
ed to the hit signal (hit#a/hit#b/.../hit#n) generated 
by the Window State Machine which corresponds to 
the given Transparency Detector. That is, hit#a is 
connected to the hit-from-WSM signal of Transpar- 
ency Detector 82a, hit#b is connected to the hit- 
from-WSM signal of Transparency Detector 82b, etc. 

Input signal select is connected to the corre- 
sponding select signal (select#a/select#b/... /se- 
lects) from Binary-to-linear Decoder 62. That is, se- 
lect#a is connected to the select signal of Transpar- 
ency Detector 66a, select#b is connected to the se- 
lect signal of Transparency Detector 66b, etc. Like 
the circuit of FIG. 8, this input signal is used to sample 
the flag which indicates whether the current pixel has 
been coded as transparent. Unlike the circuit of FIG. 
8, however, in this embodiment the flag is to be gen- 
erated from the encoded value of input signal Pixel- 
Data, rather than being directly provided. Thus, the 
Transparency Detector of FIG. 10 comprises Trans- 
parency Code Recognizer 86, as well as Latch 72 and 
And-gate 74. 

The input of Transparency Code Recognizer 86 is 
supplied by input signal PixelData, and its output is 



supplied to the data input of Latch 72. The load (latch 
enable) input of Latch 72 is supplied by input signal 
select. Specifically, Transparency Code Recognizer 
86 produces an active output signal if and only if the 

5 value of PixelData is that value (or one of those val- 
ues) which has been assigned to encode pixels as 
transparent. Thus, wheneverthe window correspond- 
ing to a given Transparency Detector is selected (by 
Priority Encoder 14), Latch 72 will be loaded with a 

10 flag which indicates whether the pixel of that window 
which is to be displayed at the current location has 
been coded as transparent. If it has been so coded, 
the (inverted) output of Latch 72, which is provided to 
And-gate 74, will inhibit the active hit-from-WSM in- 

15 put signal from being passed through to output signal 
masked-hit. That is, just as in the system of FIGS. 7 
and 8, masked-hit will be made inactive whenever a 
pixel coded as transparent has been initially chosen 
for display. Transparency Code Recognizer 86 may 

20 be implemented with conventional components, such 
as gates or digital comparators, familiar to those of or- 
dinary skill in the art. 

FIG. 11 shows a portion of a block diagram of the 
system of FIG. 7 modified to include circuitry to ad- 

25 vantageously incorporate full motion video windows. 
Although the pixel data stored in and retrieved from 
Frame Buffer Memory 22 of the systems of FIG. 7 or 
FIG. 9 may be used to represent an image generated 
in any manner, alternative methods for the retrieval of 

30 pixel data which represent full motion video (i.e., tel- 
evision) images may be provided. 

In particular, television images are updated fre- 
quently (commonly at a rate of 30 frames per second), 
and therefore the pixel data may change rapidly. For 

35 example, this data is likely to be generated "on-the- 
fly" from a television signal, in such a manner that it 
is not convenient or economical to store the pixel data 
in a memory prior to its display. Alternatively, the data 
may be provided or stored in a compressed or other 

40 non-bitmapped format, making it inefficient to require 
the generation of a bitmap for storage in Frame Buffer 
Memory 22. Thus, the system of FIG. 11 illustrates 
one embodiment of a display system in which win- 
dows comprising full motion video images may be dis- 

45 played concurrently with other overlapping windows 
which may include transparent pixels. 

The system of FIG. 11 assumes that the pixel 
data for full motion video windows are supplied to the 
display system by means separate from Frame Buffer 

so Memory 22. For example, this data may come from 
an external hardware "chip" based on a MPEG (Mo- 
tion Pictures Executive Group) standard television 
format. The system, therefore, must be able to re- 
trieve the pixel data from alternate sources (i.e., eith- 

55 er Frame Buffer Memory 22 or from an "MPEG chip"), 
depending on whether the window being displayed is 
a full motion video window. To accomplish this, the 
system of FIG. 11 comprises Full-motion-video Indi- 
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cator Latches 90a, 90b, ... 90n (hereafter 90), And- 
gates 92a, 92b,... 92n (hereafter 92), And-gates 94a, 
94b,... 94n (hereafter 94), Full-motion-video Priority 
Encoder 96, and Comparator 98, in addition to a plur- 
ality of Window State Machines 12, Priority Encoder 
14, Window Information Memory 16, Multiplier 18, Ad- 
der 20, Frame Buffer Memory 22, Binary-to-linear 
Decoder 62, Transparency Data Memory 64, and 
Transparency Detectors 66, as contained in the sys- 
tem of FIG. 7. 

In the system of FIG. 11, Full-motion-video Indi- 
cator Latches 90 each store a flag indicating whether 
the corresponding window is a full motion video win- 
dow. The output signals of Transparency Detectors 
66, are supplied to And-gates 92, respectively, rather 
than directly to Priority Encoder 14 as in the system 
of FIG.7. The inverted output signals of Full-motion- 
video Indicator Latches 90 are also supplied to And- 
gates 92. These intervening gates thereby serve to 
inhibit the "hit" signal for full motion video windows, 
ensuring that Priority Encoder 14 will select only non- 
television windows. In particular, the non-television 
window of highest priority will be selected by Priority 
Encoder 14, the appropriate pixel data and transpar- 
ency data for that window will be retrieved, and Trans- 
parency Detectors 66 will iteratively inhibit the selec- 
tion of windows whose chosen pixel has been coded 
as transparent, as in the operation of the system of 
FIG. 7. 

In this embodiment, however, the additional cir- 
cuitry of FIG. 11 will simultaneously determine the full 
motion video window of highest priority at the current 
display location (if any), excluding those for which the 
chosen pixel has been coded as transparent. In other 
words, just as Priority Encoder 14 selects the highest 
priority non-television window whose chosen pixel is 
non- transparent, Full-motion-video Priority Encoder 
96 selects the highest priority television window 
whose chosen pixel is non-transparent. In addition, 
the system of FIG. 11 will compare the priorities of the 
highest priority television window and the highest pri- 
ority non-television window, to determine which of the 
two should be displayed. Specifically, it must be de- 
termined whether the pixel data should be retrieved 
from Frame Buffer Memory 22 or from, for example, 
an MPEG chip. 

The output signals of Full-motion-video Indicator 
Latches 90 are supplied to And-gates 94, respective- 
ly, as are the "masked hit" signals masked- hit#a, 
masked-hit#b,...masked-hit#n. The output signals 
of And-gates 94, namely Video#a, Video#b,... Vid- 
eo*^ are in turn supplied to the inputs of Full-motion- 
video Priority Encoder 96, in priority order (i.e., in the 
same order as the corresponding window circuits 
supply Priority Encoder 14). Finally, Comparator 98 is 
supplied by the output signals of Full-motion-video 
Priority Encoder96 and Priority Encoder 14. Compar- 
ator 98 asserts its output signal SelectFull Mot ion Vi- 



deo if and only if the priority of the selected full mo- 
tion video window (as specified by the output of Full- 
motion-video Priority Encoder 96) is greater than the 
priority of the selected non-television window (as spe- 

5 cified by the output of Priority Encoder 14). There- 
fore, signal SelectFullMotionVideo indicates wheth- 
er the pixel data for the current display location is to 
be retrieved from the external hardware providing the 
television data or from Frame Buffer Memory 22, 

10 which contains the bitmaps for the non-television win- 
dows. If the pixel data is to be retrieved from the ex- 
ternal hardware, the output signal of Full-motion- 
video Priority Encoder 96, Full Mot ion WindowSe- 
lect, may be used to determine which full motion vid- 

15 eo window is selected for display. Note that the (un- 
masked) "hit" signals hit#a, hit#b,...hit#n corre- 
sponding to full motion video windows may be used 
to advance (clock) the pixel data for each externally 
supplied television image, since the assertion of each 

20 of these signals indicates that the current display lo- 
cation lies within the corresponding full motion video 
window. 

The system of FIG. 9 may be modified in an ana- 
logous manner to incorporate full motion video win- 

25 dows. In other words, the circuitry of FIG. 11 which 
has been added to the system of FIG. 7 may be added 
in an identical fashion to the system of FIG. 9. Wheth- 
er the transparency information is obtained based on 
the contents of Transparency Data Memory 64 as in 

30 FIG. 7, the value of PixelData retrieved from Frame 
Buffer Memory 22 as in FIG. 9, or by some other 
means, is of no import with regard to the incorporation 
of full motion video window capability. Moreover, the 
technique of the system of FIG. 9 may be extended to 

35 allow for transparency in full motion video windows, 
even though the pixel data is retrieved from a source 
otherthan Frame Buffer Memory 22. In particular, the 
transparency data for a full motion video window may 
be based on the pixel data for the full motion video 

40 window itself, such as the data retrieved from an ex- 
ternal MPEG chip. 

In an alternative illustrative embodiment of the 
present invention, pixels in a first window may be 
made "translucent" rather than (fully) transparent. 

45 Specifically, a translucency parameter may be asso- 
ciated with each pixel in a corresponding manner, for 
example, as the transparency parameter (Transpar- 
encyFlag) is associated with each pixel in the system 
of FIG. 7. Such a system may also operate in an ana- 

50 logous manner to that of the system of FIG. 7 as de- 
scribed above. In the translucency case, however, as 
each translucent pixel is detected (i.e., as Priority En- 
coder 14 iterates through successively identified 
translucent pixels), the corresponding PixelData for 

55 the translucent pixel is stored in a memory rather than 
being ignored. Then, upon the detection of a non- 
translucent pixel, the stored pixel data for the trans- 
lucent pixel(s) is "combined" with the PixelData for 
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the non-translucent pixel to generate the data to be 
displayed. In this manner, the partial "see- through" 
effect of translucency may be achieved in the resul- 
tant display. Note that the feature of FIG. 8 which em- 
ploys run length data to improve efficiency is not em- 
ployed in the case of translucency, since the data to 
be displayed is advantageously generated from the 
pixel data of translucent pixels as well as non-trans- 
lucent ones. Conventional techniques may be em- 
ployed for combining pixel data to create the appear- 
ance of translucency on the display screen. For ex- 
ample, the displayed pixel value may be obtained by 
averaging grey scale values of monochrome pixels, or 
by mixing the colors of colored pixels. 

The method of the present invention may be ad- 
vantageously employed to efficiently recognize vari- 
ous conditions in the displayed image. For example, 
when the images of multiple objects are overlaid and 
moved about on a background scene, it may be useful 
for the controlling program to determine when two or 
more objects have "collided." If two balls are "bounc- 
ing" across the screen, for example, it may be desir- 
able that their direction of motion be abruptly re- 
versed when they collide. If each object's image is 
contained in a separate window, the program control- 
ling the motion of the objects can be informed of such 
a condition by one illustrative embodiment of a dis- 
play system according to the present invention. 

In particular, the pixels in each object's window 
which immediately surround the border of the image 
of that object may be specially coded as transparent 
border pixels, as opposed to the other surrounding 
pixels which are coded as (merely) transparent pixels. 
This coding may be achieved, for example, with the 
use of an additional flag bit for each pixel (e.g., by us- 
ing two bits instead of one to encode Transparency- 
Flag in Transparency Data Memory 64 of FIG. 7). 
Then, when a display system such as the one illu- 
strated in FIG. 7 detects a transparent pixel at a given 
screen location, it is determined whether that pixel 
has been further coded as a transparent border pixel. 
If it has been coded as a transparent border pixel, the 
controlling program is apprised of a collision if the ul- 
timately displayed pixel at that location is part of the 
image of another object (i.e., not a part of the back- 
ground window). In this manner, the controlling pro- 
gram may readily determine when objects in the over- 
all screen image have collided. 

Another example of a condition in the displayed 
image which may be efficiently recognized by the 
method of the present invention is the detection of 
when a displayed cursor is pointing to a predeter- 
mined "hot spot." First, note that one illustrative ap- 
plication of a window- based display system with 
transparency according to the present invention in- 
cludes the display of a movable cursor which overlays 
the image otherwise being displayed. For example, 
the cursor may be a small arrow or set of "cross- hairs" 



whose position is controlled by the user with an input 
device such as a joystick or a mouse. Specifically, 
such a cursor may be advantageously overlaid on the 
display by specifying a window containing the image 

5 of the cursor, coding the pixels in this window which 
surround the cursor image as transparent, and as- 
signing this window the highest display priority. In this 
manner, the cursor image will overlay the rest of the 
displayed image, and the cursor may be readily 

10 moved about the screen by appropriately locating the 
cursor window. 

Given such a cursor implementation, the method 
of the present invention may be further employed to 
efficiently recognize when the cursor is "pointing" to 

15 a predetermined area of interest, or "hot spot." In par- 
ticular, the pixel contained in the cursor window which 
is located at or next to the cursor "point (e.g ., the point 
of the arrow or the intersection point of the cross- 
hairs) may be coded as a transparent cursor point pix- 

20 el. In addition, pixels contained in other windows 
which are included in a predetermined area of interest 
may each be coded as a hot spot pixel. These codings 
may be achieved, for example, with the use of addi- 
tional flag bits as described above. Then, a display 

25 system such as the one illustrated in FIG. 7 may be 
modified to incorporate hot spot detection in accor- 
dance with one embodiment of the present invention. 

Specifically, when a transparent pixel is detected 
at a given screen location, the modified display sys- 

30 tern determines whether that pixel has been further 
coded as a transparent cursor point pixel. If it has 
been coded as a transparent cursor point pixel, the 
controlling program is apprised of a hot spot detection 
if the ultimately displayed pixel at that location has 

35 been coded as a hot spot pixel. In this manner, the 
controlling program may readily determine when the 
cursor is pointing to a hot spot. 

In another embodiment of a display system modi- 
fied to incorporate hot spot detection, the coding of 

40 the cursor point as a transparent cursor point pixel 
may be achieved in an alternate manner. Specifically, 
the pixel may be coded as a (merely) transparent pix- 
el, and the display system may be further modified to 
recognize when the cursor point is located at the cur- 

45 rent screen location. For example, the cursor window 
may comprise a "northwest" pointing arrow such that 
the cursor point is the uppermost and left-most pixel 
in the window. Since the cursor window has been as- 
signed as the window of highest priority, Window 

so State Machine 12a may recognize that the cursor 
point is located at the current screen location by de- 
termining that Xstart = Xscreen and Ystart = 
Yscreen. In other words, the current screen location 
is the location of the cursor point when the current lo- 
ss cation is coincident with the upper left hand corner of 
the cursor window. Then, when the further modified 
display system determines that the current screen lo- 
cation is, in fact, the location of the cursor point, the 
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controlling program is apprised of a hot spot detection 
if the ultimately displayed pixel at that location has 
been coded as a hot spot pixel. 



Claims 

1 . Asystem for selecting a pixel for display at a given 
location in a display of a display device, the dis- 
play comprising first and second windows asso- 
ciated with first and second sets of pixels, re- 
spectively, the first and second sets of pixels cor- 
responding to first and second pluralities of loca- 
tions in the display, respectively, the first and 
second pluralities of locations having at least one 
location in common, the first window having a dis- 
play priority higher than a display priority of the 
second window, each of the pixels in the first set 
having a display control parameter associated 
therewith, the display control parameters of one 
or more pixels in the first set comprising a value 
assigned independently of the display control 
parameters of one or more other pixels in the first 
set, the system comprising: 

means for generating a first signal when 
the given location is included within the first plur- 
ality of locations; 

means for generating a second signal re- 
sponsive to 

(i) the first signal and 

(ii) a predetermined value of the display con- 
trol parameter of a pixel in the first set, said 
pixel in the first set corresponding to the given 
location; and 



5. The system of claim 4 wherein the display control 



parameter comprising the predetermined value 
further reflects a number of successive pixels 
which have been coded as transparent pixels. 

5 6. The system of claim 4 wherein the display control 
parameter associated with each of the pixels in 
the first set comprises pixel data and the prede- 
termined value comprises a predetermined pixel 
data value. 

10 

7. The system of claim 3 wherein the first window 
comprises an image from full motion video. 

8. The system of claim 3 wherein the second win- 
15 dow comprises an image from full motion video. 

9. The system of claim 3 wherein the predetermined 
value of the display control parameter reflects 
that said pixel in the first set has been coded as 

20 a translucent pixel. 

10. The system of claim 3 wherein the predetermined 
value of the display control parameter reflects 
that said pixel in the first set has been coded as 

25 a transparent border pixel. 

11. The system of claim 3 wherein the predetermined 
value of the display control parameter reflects 
that said pixel in the first set has been coded as 

30 a transparent cursor point pixel. 

12. A method for selecting a pixel for display at a giv- 
en location in a display of a display device, the 
display comprising first and second windows as- 
sociated with first and second sets of pixels, re- 
spectively, the first and second sets of pixels cor- 
responding to first and second pluralities of loca- 
tions in the display, respectively, the first and 
second pluralities of locations having at least one 
location in common, the first window having a dis- 
play priority higher than a display priority of the 
second window, each of the pixels in the first set 
having a display control parameter associated 
therewith, the display control parameters of one 
or more pixels in the first set comprising a value 
assigned independently of the display control 
parameters of one or more other pixels in the first 
set, the method comprising: 

generating a first signal when the given lo- 
cation is included within the first plurality of loca- 
tions; 

generating a second signal responsive to 

(i) the first signal and 

(ii) a predetermined value of the display con- 
trol parameter of a pixel in the first set, said 
pixel in the first set corresponding to the given 
location; and 

selecting a pixel from the second set in re- 



means, responsive to the second signal, 35 
for selecting a pixel from the second set, said pix- 
el from the second set corresponding to the given 
location. 

2. The system of claim 1 wherein the means for gen- 40 
erating the second signal comprises: 

means for inhibiting the first signal in re- 
sponse to the predetermined value of said display 
control parameter of the pixel in the first set cor- 
responding to the given location; and 45 

means for producing the second signal re- 
sponsive to the inhibiting means. 

3. The system of claim 2 wherein the means for pro- 
ducing the second signal comprises a priority en- so 
coder. 

4. The system of claim 3 wherein the predetermined 
value of the display control parameter reflects 
that said pixel in the first set has been coded as 55 
a transparent pixel. 
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sponse to the second signal, said pixel from the 
second set corresponding to the given location. 

13. The method of claim 12 wherein the step of gen- 
erating the second signal comprises: 5 

inhibiting the first signal in response to the 
predetermined value of said display control para- 
meter of the pixel in the first set corresponding to 
the given location; and 

producing the second signal responsive to 10 
the first signal being inhibited. 

14. The method of claim 13 wherein the step of pro- 
ducing the second signal comprises producing 

the second signal with use of a priority encoder. 15 

15. The method of claim 14 wherein the predeter- 
mined value of the display control parameter re- 
flects that said pixel in the first set has been cod- 
ed as a transparent pixel. 20 

16. The method of claim 15 wherein the display con- 
trol parameter comprising the predetermined val- 
ue further reflects a number of successive pixels 
which have been coded as transparent pixels. 25 

17. The method of claim 15 wherein the display con- 
trol parameter associated with each of the pixels 
in the first set comprises pixel data and the pre- 
determined value comprises a predetermined 30 
pixel data value. 

18. The method of claim 14 wherein the first window 
comprises an image from full motion video. 

35 

19. The method of claim 14 wherein the second win- 
dow comprises an image from full motion video. 

20. The method of claim 14 wherein the predeter- 
mined value of the display control parameter re- 40 
fleets that said pixel in the first set has been cod- 
ed as a translucent pixel. 

21. The method of claim 14 wherein the predeter- 
mined value of the display control parameter re- 45 
fleets that said pixel in the first set has been cod- 
ed as a transparent border pixel. 

22. The method of claim 14 wherein the predeter- 
mined value of the display control parameter re- 50 
fleets that said pixel in the first set has been cod- 
ed as a transparent cursor point pixel. 
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